Quantum walks: a Markovian perspective 
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Abstract 

For a continuous-time quantum walk on a line the variance of the po- 
sition observable grows quadratically in time, whereas, for its classical 
counterpart on the same graph, it exhibits a linear, diffusive, behaviour. 
A quantum walk, thus, propagates at a rate which is hnear in time, as 
compared to the square root rate for a classical random walk. Indeed, 
it has been suggested that there are graphs that can be traversed by a 
quantum walker exponentially faster than by the classical random ana- 
logue. In this note wc adopt the approach of exploring the conditions to 
impose on a Markov process in order to emulate its quantum counterpart: 
the central issue that emerges is the problem of taking into account, in 
the numerical generation of each sample path, the causative effect of the 
ensemble of trajectories to which it belongs. How to deal numerically with 
this problem is shown in a paradigmatic example. 

1 Paradigmatic examples 

The identity 

satisfied by the Bessel functions of first kind and integer order Jx{t), shows that 
the function 

p{t,x) = Utf (2) 

is, for each time t, a probability mass function on the relative integers. 

We raise here the question of finding examples of phenomena of probabilistic 
time evolution described by this probability mass function. 



We will give two distinct, apparently very diflFerent, answers to the above ques- 
tion: finding the relationship between the two distinct examples we are going to 
exhibit below and discussing the extent and generality of this relationship will 
be the main focus of this paper. 

1.1 First Example 

The function 

^{t,x)^t^Ut) (3) 
is the solution of the Schrodinger equation on the relative integers 

i^^^Pit, x) = ~^Wt, x~l) + ^{t, X + 1)) (4) 
under the initial condition 

^(0,x) = 5o,x. (5) 

Otherwise stated, the function p{t,x) = Jxit)^ is, at every time t, the proba- 
bility distribution of a continuous-time quantum walk on the graph having the 
relative integers as vertices, with edges between nearest neighbour sites [1]. This 
quantum walk starts at time from the origin. 

Figure [O] a density plot of p{t,x) — Jx{t)'^, clearly shows the linear prop- 
agation expected in such a quantum walk. The reader more intersted in the 
phenomenon than in the equation (in this case eq. Q) will appreciate recog- 
nizing in figure |1.1| the intensity pattern of propagation of light in a waveguide 
lattice [g. 

1.2 Second example 

Consider a birth-and-death random process q{t) on the relative integers, evolving 
according to the following rules: 

i. geometric mean rule: for every edge {x,x-\- 1} and every time t the frac- 
tion of transitions per unit time taking place along this edge (number of 
transitions x ^ x -\- 1 plus number of transitions x + \ ^ x per unit 
time)/(sample size) is equal to the geometric mean of the probability of 
the process being in x and the probability of being in a; + 1; 

ii. local unidirectionality rule: for every edge {x,x + 1}, and depending on 
time t, only transitions x — > a;+l or only transitions x+l — > x are allowed; 

iii. "horror vacui" rule: for every site x, if at a time the probability of being 
in X passes through the value 0, then there is an interval of time following 
tx in which along the edges {x—l, x} and {x, x+l} only transitions toward 
X are allowed; this time interval terminates as soon as the probability of 
being in one of the two neighbours of x crosses the value (at which 
instant the "horror vacui" rule takes hold for such a neighbour). 
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Figure 1: A density plot of p{t,x) = \il){t,x)\^. The profile of p{30,x) as a 
function of x is shown on the right. 

As to the initial conditions, we suppose that there exists tq > such that, for 
every integer x, 

p{t, x) = P{q{t) = x)>0, for < t < TO (6) 

and 

\im^ p{t, x) = 6o,x- (7) 

Together with the above initial condition on the position of the process, we 

impose, as a condition on its initial "velocity", the requirement that in the 
time interval [0, tq) only transitions taking the process away from the origin are 
allowed. 

We, finally, impose a left-right symmetry on the position of the process, in the 
form 

p{t,x)=p{t,-x) (8) 

and a left-right symmetry on its 'Velocity" expressed in terms of its birth rate 
X{t, x) and its death rate x) as 

X{t,x) = p,{t,-x). (9) 
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The transition probabilities per unit time X(t, x) and fi(t, x) are defined, respec- 
tively, by 

p{t + T,x+l;t,x) ■ \{t, x) + o(r) (10) 
p(t + T,x — l;t,x) — T ■ x) + o(t) (11) 

for T ^ 0+. 

Here and elsewhere we indicate by p{t, x; to, xq) the conditional probability 

P{q{t) = x\q{t^) - Xo) 

of finding the process at time t in x, given that at time Iq it is in xq. 
Condition ^ can, now, be written as the equation 

A(t, x)p{t, x) + fi{t, X + l)p{t, x + l) = ^/p{t,x)p{t,x + l), (12) 

relating the three unknown fields A, p and p. The left hand side is, indeed, the 
probability per unit time of a transition along the link {x, x + 1}. Notice that, 
because of equation (12 1 allows, locally, to express A or /i as a function of 
the values of p at two neighbouring points. 

A further equation involving the unknown fields is the continuity equation 

f^p{t,x) = {p{t,x + l)p{t,x+l) - X{t,x)p{t,x))+ (13) 

+ (A(t, X - l)p{t, X - 1) - p{t, x)p{t, x)), 

expressing the fact that the probability mass at x increases because of transi- 
tions X ± 1 — > X and decreases because of transitions a; — > x ± 1. 
In the time interval [0, tq), we can therefore write, using also the left-right sym- 
metry and the initial condition of allowing only transitions taking the process 
away from the origin (namely, for < ^ < ''o, A(<,x) > for x > and 
n{t,x) > for X < 0), 

j^p{t,Q) = -2Vp(t,0)p(t,l) (14a) 
^p(t,x) = +^p(i,x- l)p{t,x) - y/p{t,x)p{t,x + 1), for X > 0.(14b) 



Equations (14) are satisfied by p{t,x) — Jx{t)^, for values of t such that Jx{t) is 
positive for every non negative integer x. This determines the numerical value 
of To to be the smallest positive solution of the equation Jo(i) — 0, namely 

To = 2.4048. (15) 

For a suitable value of ti > tq condition ( pli| will allow, in the time interval 
[to,ti), for transitions ±1 0, so that equations (14 1 are to be substituted, in 
this interval, by 

^p(i,0) = +2^pit,0)p{t,l), (16a) 

^p(i,i) = -Vp(^,0)p(t,l)~^/p(^,2)p(^,l) (i6b) 

^p{t,x) = +y^p{t, X — l)p{t, x) — •\/ p{t, x)p{t, X -I- 1), for X > 1. (16c) 
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Figure 2: A sample of 500 paths of the stochastic process of Example 2. For the 
purpose of comparison with figure [0] the empirical distribution at time t = 30, 
of a sample of 5 • 10^ trajectories, is shown on the right. 



Equations (16 1 are again satisfied by p{t,x) = Jx(t) , but, this time, for values 
of t such that Jo{t) < and Jx{t) is positive for every positive integer x. This 
determines the numerical value of ti to be the smallest positive root of Ji{t) — 0, 
namely 

Tl = 3.8317. (17) 

The above considerations can be iterated: using the fact that between two 
consecutive zeroes of Jx{t) there is one and only one zero of Jx+i{t), one can 
control the changes of sign determined by ( pli| in the continuity equation, to the 
effect of proving that the process q{t) described by the conditions posed above 
satisfies, for every t, the condition 

pit,x) = Piqit)^x)^Utf. (18) 

Figure 2, to be compared with figure 1, shows a few sample paths of the process 
lit). 

The reader more interested in the phenomenon than in the equations (in this 



case the continuity equation ( 13 1 for the evolution of p(t, x) and the forward 
Kolmogorov equation for the evolution of p{t,x; to, Xq)) will see, in section [3j 
how the numerical procedure leading to figure |1.2| actually makes use only of a 
step by step implementation of the dynamical rules ( pli| . 
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2 Quantum walks vs. random walks 



In this section we look at quantum mechanics as a metaphor suggesting, at the 
heuristic level, an interesting dynamical behaviour for a random (Markov) pro- 
cess exploring a graph or decision tree. We base our work on the classical results 
of Guerra and Morato [3] on the formulation of quantum-mechanical behaviour 
in terms of controlled stochastic processes; the picture of a quantum walk that 
emerges through its stochastic analogue is that of a swarm of walkers moving 
according to transition rules involving the distribution of the entire swarm. 

Consider a quantum system having as state space a Hilbert space the dimen- 
sion of which we will indicate by s, and as generator of the time evolution a 
Hamiltonian operator that we will indicate by H. 

Having fixed an orthonormal basis, | ), | 02 ), • ■ • , | 0s ), a graph G is defined, 
starting from the selected basis and from the selected Hamiltonian, by stating 
that G has = {1, s} as its set of vertices and edges {k,j} such that j ^ k 
and |(0fe|ff|0,)| >0. 

In the context of this section, the graph G will play the role played, in the more 
elementary context of Example 1 of section 1, by the linear graph having the 
relative integers as vertices, with edges between nearest neighbour sites. Simi- 
larly, the role played in section 1 by equation Q will be played in this section 
by the Schrodinger equation in the representation determined by the selected 
basis: 

with 

^^fc,, = (0fe|i?|0,)- (20) 

We pose in the following terms the question of finding in the general context of 
this section, an analogue of Example 2 of section 1: 

Easy problem: find a constructive procedure associating with each solution 



of (19 1 a Markov process q{t) on the graph G having at each time t probability 
distribution 

p(i,fc) = P(g(t) = fc) = |^(i,fc)|2. (21) 
If this process exists and satisfies (for a suitable field v of transition probabilities 



per unit time) the condition, that we impose as an analogue of conditions (10 1 



and (11 



p{t + T,j-t,k) = P{q{t + T)=j\q{t)^k)=T-Vj{t,k) + o{T) (22) 
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for T ^ 0+ and for each j being a neighbour of k in the graph G, then it will 
satisfy the continuity equation 

= J2 P{t,])vk{td)- P{t,k)v,{t,k)= (23) 

jeN{k) 

V {p{t.])Mt.]) + P{t,k)vj{t,k))[ u i,\ u i,\ 

In the above equation, we have indicated by N{k) the set of neighbours in G of 
the vertex k, namely the collection of vertices j such that j ^ k and {j, k} is an 
edge. 

In the second line of equation ( 23 1 we have separated the term 

P{t,3)vk{t.3) + P{t,k)vj{t,k), 

symmetric in j and k (on the analogue of which we have imposed in Section 1 
the geometric mean rule), from the antisymmetric term 

P{t,j)i^k{t,j) - p{t,k)iyj{t,k) 
p{t,j)t^k{t,j) + p{t,k)iyj{t,k)' 

of absolute value < 1 , representing the net relative flux of probability mass from 
j into k. 

If, now, the same p appearing in (23) satisfies also p{t,k) = \'ip{t, k)]"^ for a ^ 
satisfying (19 1, it must be 



^t,k) = ^p{t,x)exp{f S{t,k)) (24) 
for some phase function S to be determined by inserting the Ansatz (p4| into 



equation (19 1. Doing so, and separating the real and imaginary parts of the 
resulting equation, one gets two equations: 



p{t,k)^^H,,,- ^ /^cos(/3,,,(i)) (25) 

and 

-p(t,fc)= J2 '2hk,jVpit,k)pit,j)sm{(3k,j{t)), (26) 

j&N(k) 

where we have set 

hkj = \Hk,j\ (27) 

and 

(3k At) = ArgiHkA + 3(1, j) - S{t, k). (28) 
In order to check that our Easy problem admits at least one solution, it is 
sufficient to compare the purely kinematic relations 

^P^t,k)= ^ 2hkj a/ p{t, k)p{t, j) sin(/3fc J (t)) , 

jeNik) 
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and 

viewed, for assigned ■0 and therefore for assigned p and (3, as constraints on 
the unknown transition probabihties per unit time of the process q(t) to be 
constructed. The simplest way to satisfy this constraint is by requiring term by 
term equahty in the sums that appear in the right hand sides, and by equating 
in each term the symmetric and antisymmetric factors. 
We thus get the equations 



p{t,jH.{t,j)+p{t,k)i^,{t,k) - 2hk,jVp{t,k)p{t,j) (29) 
p{t,jH{t,j)-p{t,kyj{t,k) = 2hk.jVpit,k)p{t,j)sm{(3k,j{t)) (30) 



that are solved by 



= hk,,^^^{l + sm{Arg{Hk,,) + S{t,j)-Sit,k))) (31) 

for k e N{j). 

For more details, and for the physical motivation (related to questions of time 
reversal invariance) of the merits of this particular choice, we refer to [4]. 



It is immediate to check that ( 29 1 is precisely the geometric mean rule (|i| of 
section 1. 

It is also an easy exercise to check that pTj) specializes, due to the phase factor 
in equation to conditions ^ and (|iii[) in the simple context of section 1. 

3 Autonomous generation 

The Hard problems, as opposed to the kinematical Easy problem reviewed in 
section [2] are 



I. understand (25 1 as a dynamical condition on the processes q{t) that solve 



our Easy problem; 

II. autonomously simulate these processes by actual implementation of this 
dynamical condition. 

Problem |l] is discussed in full detail in [4 following the general approach of [3] in 
which stochastic control theory is successfully proposed as a very simple model 
simulating quantum-mechanical behaviour. 

We are not able to tackle problem (|ll]) in its generality. We can only go back 
to section 1 and show that the three dynamical rules and the initial conditions 
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stated there in assigning Example 2 are enough to generate the sample paths 



of figure 1.2 



This is far from obvious because of the geometric mean rule: it requires, in the 
numerical generation of each sample path, to take into account the causative 
effect (through the estimated probability distribution) on each trajectory of the 
ensemble of trajectories to which it belongs |5] . 



Even to show, as in figure 1.2 a small sample of trajectories, the need of carefully 
estimating at each time step the density p imposes the simultaneous generation 
of a large number Ntr. of trajectories. 

The numerical procedure leading to figure |1.2[ makes, by purpose, no refer- 
ence to the solution of the continuity equation we have given in section 1, nor 
to the solution of the Kolmogorov equations for the conditional probabilities 
p{t,x;to,xo) that can be easily found by similar techniques. We present here 
this procedure in some detail because the challenges one meets in simulating 
the process q{t) by implementing rules ([u]), ( pli| and the initial conditions 
listed in section 1 give an operational meaning to the notion of autonomous 
simulation. 

The state of the system at each time t — t ■ k, where the integer k runs from 1 
to rigteps and r is the time step, is described by the pair 

• configuration array of length Ntr'- its element qj{t) indicates the cur- 
rent position of the j-th trajectory; a space cut-off is introduced through 
an integer parameter L such that each trajectory is followed as long as 

< q(t) < L; the empirical density Pemp of the process at each time is 
estimated from the configuration array; 

• transition array indexed from —L to L: its x-th element is an ordered 
pair of bits {rrix, Ix)'- if — 1 (resp. Ix — 1) then transitions x — > x — 1 
(resp. X x + 1) are allowed, whereas if urix = (resp. Ix — 0) they are 
forbidden. 

In our implementation ntr. — 5- 10^, t — 0.05, and the process has been followed 
up to time t^ax = t • ngteps — 100, well beyond the time window shown in figure 



1.2 the space cut-off has been set at L = 150. 

The algorithm consists of the iteration rtsteps times of the following steps: 

1. estimate Pemp from the configuration array; 

2. increment each qj{t) by Move(t, qj(t)), where the random variable Move{t, x) 
takes the values —1, 0, -1-1 with probabilities T-p,empit, x), 1— r-(/iem,p(i, x)+ 
Aemp(i, x)),T ■ Xempit, x) , respectively. 

The empirical transition rates Xemp and fiemp are here given by 



Xemp{t, x) — y ij^~x) (32a) 

Pempit,x) = / Pemp(^,^a: ^^1) ^ ^^^j^,^ 
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3. estimate the new empirical distribution Pemp{t + t, x); 

4. if pejrip(t,x) > and Pemp{t + T,x) = then update the transition 
array following the "horror vacui" rule ( pli| ), namely setting Ix-i = 1 
and mx+i = 1, and restore the local unidirectionality rule by setting 
(m„/,) = (0,0). 

In the initialization step the transition array has been given the initial assign- 
ment 

( (1,0) if x < 
(m^Jx) = <(l,l)if2; = 
[(0,1) if x > 

Before discussing the initialization of the configuration array, we observe that 
the rough first order updating rule of step 2. runs into trouble if a proposed 
transition involves a site at which Pemp vanishes, the problem being with zeroes 



of the numerators under the square root of ( 32a I and ( 32b I . The most evident 
form of this fact is that, given that the process at time is at position 0, the 
probability that it moves at all in a time step is 

l-^'(T) = y + 0(r^). (33) 

We have found an inexpensive way out of this difficulty by initializing the con- 
figuration array by the assignment: 

q,{0) = 0, for J = {2L + l) + l...,Ntr. 
qj{0) = j-L-1, for j = l,...,2i + l 

The first line says that most of the trajectories start from the origin; the second 
that trajectory 1 starts from —L, . . ., trajectory 2L + 1 starts from L. 
The second line makes sure that initially there is at least one trajectory per site; 
this situation is restored, after step 4. by: 

5. set (7j (< + t) = j - L - 1, for j = 1, . . . , 2L + 1. 

The dummy trajectories labelled by j = 1, . . . , 2L + 1 provide some probability 
mass when needed to prevent the first order procedure from getting stuck. 
Comparison between figures |1.1| and |1.2| gives an idea of how well our simple 
procedure fills the configuration array . 

An analogous comparison is conducted in figure [3] for the transition array: the 
issue there is how well our procedure catches the instants of time at which the 
control mechanism expressed by the ^^horror vacui" rule takes hold, namely the 
zeroes of Jx{t)- 
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Figure 3: Thin solid lines: graphs of Jx{t) as a function of t for several values of 
X. Thick dashed lines: graphs, as a function of t, of the fraction of trajectories 
that visit x at time t. 



4 Conclusions and outlook 

If you give me a quantum walk efficiently exploring a graph or decision tree [B], 
I take your computational basis, your initial condition and your Hamiltonian 
and cook for you a stochastic process by computing its transition probabilities 
per unit time according to the recipe of section 2 and its transition probabilities 
p{t,x]tQ,XQ) by integration of the Kolmogorov equations (this can be done in 
quite explicit terms for the Example 2 of section 1) or by a clever exploitation 
of a few rules controlling the dynamics, as done in section 3. The discussion of 
section 2 makes it clear that my random walk will, by construction, visit your 
graph or decision tree as efficiently as your quantum walk. 

Can the above statement be reconciled with the statement that the quantum 
glued trees algorithm of [7] outperforms any classical algorithm? How are the 
classical alternatives defined in the original literature on exponential speedup by 
quantum walk? Does the causative effect of the ensemble disqualify a Markov 
process from being classical ? 

On these points, all we can do is to advance a conjecture: the cost of my random 
simulation of your quantum walk is hidden in the size Ntr. of the sample I am 
required to generate. We have indeed called attention, since section 1, on the 
geometric mean rule: for every edge of your graph the probability per unit time 
of a transition of my process along that edge is equal to the geometric mean of 
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the probabilities of the process at the two vertices joined by that edge. 



We pose as a problem of future research the quantitative assessment of the 
cost (as measured by N^r.) of the density estimation step required before each 
updating in the simulation. 
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